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Abstract 

In this article, wc discuss the problem of establishing relations between information measures assessed 
for network structures. Two types of entropy based measures namely, the Shannon entropy and its gen- 
eralization, the Rcnyi entropy have been considered for this study. Our main results involve establishing 
formal relationship, in the form of implicit inequalities, between these two kinds of measures when defined 
for graphs. Further, we also state and prove inequalities connecting the classical partition-based graph 
entropies and the functional-based entropy measures. In addition, several explicit inequalities are derived 
for special classes of graphs. 

Keywords: Information Measures, Information inequalities. Topological complexity. Shannon Entropy, 
Renyi Entropy, Networks. 

Introduction 

Complexity of a system, in general, deals with the intricate design and complex interrelations among the 
components of the system. One of the plausible categorization of complexity analysis is based on the 
functional behavior, topological properties, and/or at the compositional level of a system [T]. Over the 
years, all these categories have been implemented and contemplated concurrently in all branches of science 
and social science. However, here we restrict our attention to the topological complexity of network-based 
systems. This relates to determining the complexity of the underlying graph structure of a network. The 
quantitative estimation (using measures/indices) of topological complexity has been proven useful in 
characterizing the networks and has widely spread into all branches of natural sciences, mathematics, 
statistics, economics and sociology; for e.g., see pHTTj. In the study of complexity, information theory 
has been playing a predominant role. That is, the measures based on Shannon entropy has been very 
powerful and useful in determining the topological complexity of networks; see [TJ|ni[IH[I3] • Apart from 
Shannon entropy, its generalizations such as Renyi entropy |14| . Daroczy entropy |15| have also been 
identified as potential contributors in characterizing network-based systems; see [16) . 

In this paper, we deal with an interesting and significant aspect when analyzing the complexity of 
network-based systems. Namely, we establish relations between information-theoretic complexity mea- 
sures |17[|18] . Investigating relations (in the form of inequalities) among measures, by and large is very 
useful when studying large scale networks where evaluating the exact value of a measure is computation- 
ally hard and time-consuming. In addition, they also serve as a tool for solving problems. In communica- 
tion theory, inequalities have paved way to the development of so-called algebra of information, various 
rules involving mutual information and entropy measure. For example, inequalities such as Young's in- 
equality, Brunn-Minkowski inequality. Fisher's information inequalities have been main contributors to 
the mentioned development |19i - [2Tj . 

Inequalities involving information measures are also referred to as information inequalities |22| . They 
are classified in two types, namely the implicit information inequalities and explicit information inequal- 
ities. In particular, when information measures are present on either side of the inequality, we call it 
an implicit information inequality [22| . while in the latter, the information measure is bounded by a 
function of parameters (or constants) involved. For some of the recent works in this direction, we refer 

to [miiiHii]. 

The main contribution of this paper, is to establish implicit information inequalities involving the 



2 



Shannon entropy and the Renyi entropy measures when applied to network graphs. Secondly, we also 
present implicit inequalities between Renyi entropy measures having two different types of probability 
distributions with additional assumptions. To achieve this, we analyze and establish the relation between 
classical partition-based graph entropies [T51[^[?7] and the non-partition based (or the functional) based 
entropies [28]. Finally, we apply the obtained inequalities to specific graph classes and derive simple 
explicit bounds for the Renyi entropy. 



Methods 

In this section, we state some of the definitions of information-theoretic complexity measures |29fl32j . 
Measures are based on two major classifications, namely partition based and partition-independent mea- 
sures. Some basic results on inequalities on real numbers |2HI33| are also presented towards the end of 
the section. 

Let G = (V, E) be a graph on vertices where V = {vi, V2, ■ ■ ■ , wat} and E C V x V . Throughout 
this article, G denotes a simple undirected graph. Let X be a collection of subsets of G representing a 
graph object. Let F be an equivalence relation that partitions X into k subsets Xi, X2, . . . , X^., with 
cardinality \Xi\, for 1 < i < fc. Let {pi,P2, ■ ■ ■ ,Pk} denote the probability distribution on X w.r.t F, such 

that Pi = (1 < i < fc), is the value of probability on each of the partition. 

For graphs, the Shannon's entropy measure |34| is also referred to as "the information content of 
graphs" [35113^ and is defined as follows: 



Definition 1. The mean information content, Hy{G), of G with respect to F is given by 

k k 

Hr{G)= -J2p,log,p,^ _^^log,^. (1) 



Note that while the above definition is based on partitioning a graph object, another class of Shannon 
entropy has been defined by [29] where the probability distribution is independent of partitions. That is, 
probabilities were defined for every vertex of the graph using the concept of information functionals. 

Suppose f : V ^ is an arbitrary information functional [29| that maps a set of vertices to the 
non-negative real numbers and let 

Piv) = ^J^--, (2) 
denote the probability value oi v G V. Here, 

Definition 2. The graph entropy, Hf{G), representing the structural information content of G |29[|30j 

is then given by, 

Hf{G) = -f:p{v^) losMv.) = - E ^#7^— l°g2 (3) 

^=l z=lEj = l/K) = 

As a follow-up to Shannon's seminal work [32], many generalizations of the entropy measure were 
proposed in the literature [l4l[15l[37] . These generalized entropies were recently [16], extended to study 
the class of graphs. In the following, we present one such generalization from |16] . namely the Renyi 
entropy for graphs. 
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Definition 3. The Renyi entropy Ha_r{G), for < a < oo and a ^ 1, of a graph G [16] is given by, 



\x\ 



(4) 



Here, T is the equivalence relation on a graph object and pi (1 < i < fc) denotes the probabilities defined 
on the partition induced by T. 

It has been proved that Renyi entropy is a generahzation of Shannon entropy and in the hmiting case 
when a 1, the Renyi entropy equals the Shannon entropy [37] , 

Similar to expression ([3]) , the Renyi entropy can be immediately extended |16j to partition-independent 
probability distributions defined on G. 

Definition 4. Let Haj{G), for < a < (X) and a ^ I, denote the Renyi entropy [T6] defined using an 
information functional f. Then 



(5) 



Next we state some interesting inequalities from the literature that are crucial to prove our main 
results. One of the well-known result for the real numbers is stated as follows [33l. 



Lemma 1. [33] Let x,y > and x =/= y be real numbers. Then 

ry'^~^{x — y) < x^' ~ y^ < rx^~^{x — y), 

if r < or r > 1, 

rx'^~^{x — y) < x^ — y^ < ry^~^{x — y), 

i/0 < r < 1. 

A simplified form of Minkowski's inequality is given by |33j : 
Lemma 2. [33] lfr>0, then 

(a, +b, + --- + i,rf < iJ2ia.yf + iJ2ihrf + ■ 



(6) 
(7) 

□ 



where i/0<r<l and R ~ ^, if r > 1. 

As an extension of discrete Jensen's inequality, the following inequality was derived in |21j 
Lemma 3. [21j Let Xk € (0, oo), for 1 < k < n, and pk > such that X]fc=i-Pfe ^ 1- Then 

k—1 / k—1 k,i—l 



(8) 



□ 



(9) 



□ 
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Results 

In this section, we present our main results on implicit information inequalities. To begin with, we 
establish the bounds for Renyi entropy in terms of Shannon entropy. 

Theorem 4. Let p{vi),p{v2), ■ ■ ■ ,pivN) be the probability values on the vertices of a graph G. Then the 
Renyi entropy can be bounded by the Shannon entropy as follows: 
When < a < 1, 

i/,(G)<H.,,(G)<i^,(G)+ "'"-'«_;-°>°-' . (10, 

When a> 1, 

HfiG) - ^"^1^2^^-^^^ < H.AG) < HfiG), (11) 

where p = max . 

i,k p(Vk) 

Proof: It is well known [37] that the Renyi entropy satisfies the following relation with the Shannon 
entropy . 

HajiG) > i?/(G), if < a < 1, (12) 

and 

HajiG) < Hf{G), if a > 1. (13) 



Next let us prove the other bound of Haj{G) 
Let 
get, 



Let p = max \ . Consider, the inequality (O from Lemma[3]with pi^ — p{vk) and Xk = pivk)"^^- We 

i,k p(Vk) 



(N \ N 1 ^ 

p{vkT ] - - 1) 51 P^^*^) i°g2 pM < ^ 
fc=l / k=l i,k=l 



{p{vk)p{vi)Y 



Now we prove the theorem by considering intervals for a. 
Case 1: When < a < 1. 

Dividing by (1 — a) on either side of the expression (|14p . we get 

N 

21n2(l-a) {p{vk)p{vk)) 
Using inequality ^ from Lemma [1] with ?■ = a — 1 < in the following sum we get 



(14) 



H^j{G)-Hf{G) < -— i ^i^^>Pi^(p(.,)"-i -pivkT-'?. (15) 

21n2(l - a) (n Ufc n ufc r ^ 



i^k 

N , . 

< 5] [(a - l){p{v.) -p(«fc))]V"-' (since p max^), (17) 

i=ik 
N 

< ^ (a - 1) V""' (since p{v,) - p{vk) < 1), (18) 

k.i=l 
i^k 

= p^-^ia-lfNiN -I). (19) 
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Thus, expression becomes 

i.„,(G)-g,(G)< '-°-'"-;_;^'"-" ^ 

which is the required upper bound in pop . 
Case 2: When a > 1. 

In this case dividing by (1 — a) on either side of the expression (jlSp . we get, 

^ ^ ^T;r2(b^ £ (p(Sw;' - (>■("■)■'- (20) 

Using inequahty (O with ?■ = a — 1 < 1 for 1 < a < 2 and inequahty ([6]) with r^a — 1>1, forQ;>2 
we get. 



> 



^ [{a-l)ipiv,)-p{vk))? ^ ^22) 

1 



P' 



(a - l)2iV(iV - 1) 



> aJ ' (sincepfa)-p(z;fc) > -1), (23) 

fe,i=i 



pa-2 



(24) 



Thus, expression ([^(7)) becomes 



21n2 • p° 

which is the desired upper bound in (fTTj) . □ 
Corollary 5. In addition, suppose e = max(p(ui) —p{vk)), then 

i,k 

H,iG) <H.AG)< i/KG) + ^^^^^^^fc^^^, (25) 

when < a < 1 and 

Hf{G) >H^j{G)> iJ,(G) - ^^^-i^fcll, (26) 

when a > 1. □ 

Remark 6. Observe that the Theorem[4l in general holds for any arbitrary probability distribution with 
non-zero probability values. The following theorem illustrates this fact with the help of a probability 
distribution obtained by partitioning a graph object. 

Theorem 7. Let pi, . . . be the probabilities of the partitions obtained using an equivalence relation T 
as stated before. Then 

Hr{G) <H^siG)< ilr(G) + ^^^i^^^l^, (27) 
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when < a < 1, and 

HriG) >H^.r{G)> Ht{G) ~ (28) 

when a > 1. 

Proof: Proceeding similar to Theorem |4l we get the desired result. □ 
In the next theorem, we establish bounds between like-entropy measures, by considering the two 
different probability distributions. 

Theorem 8. Suppose \Xi\ < /(u,), for 1 < i < k, then 

i/„,r(G) < ^"j(G) + Y^log(^), (29) 

i/0 < a < 1; 

Ho..riG) > ^"./(G)-^l°g(^)' (30) 
ifa>l. Here S = Y^iLi /(^O- 

Proof: Let S = fi'^i) thus p{vi) = — . Now, given \Xi\ < f{vi), for 1 < z < A: we have, 

\Xi[ f(v^ ^ Spjv,) 

\x\ \x\ \x\ ■ > 

By raising either side of the expression to the power a, and by applying summation over i from 1 to /c 
on either side we get, 



i=l ^1 ' ^ i=l ^ I ' 



E(?'("0)"- (33) 



Taking logarithms on either side, we obtain 

'o^tC-mY < i°gf^) E(pi^'^)r, (34) 



i=l 

k 



i=l 
N 



< log(^) +\ogJ2{p{v,)r. (36) 
Now we make two cases, depending on a as follows: 

Case 1: When < a < 1, dividing by 1 — a on either side of equation ([36]), we get 

H^HG) < i/.j(G) + -^logA. (37) 

i — a \A\ 

Case 2: When a > 1, dividing by 1 — a on either side of equation (|36|) . we get 

H^.riG) > H^.f (G) + log (38) 

L — a \X\ 

Expressions ([57]) and psp are the required inequalities. □ 
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Remark 9. A similar relation by considering Hr{G) and Hf{G) has been derived in j24) . 

We focus our attention to the Renyi entropy measure defined using information functionals (given by 
equation ([S])) and present various bounds when two different functionals and their probability distributions 
satisfy certain initial conditions. A similar study has been performed in the case of Shannon entropy; 
see [niHS- 

Let fi and /2 be two information functionals defined on a graph G ~ {V,E). Let 5*1 = J2^=i 
and 52 = '^iLif2{yi)- Let Pfi{v) and Pf^iv) denote the probabilities of /i and /2, respectively, on a 
vertex v & V. Let -f^a./i (G) and H^j^ (G) denote the Renyi entropy based on the functionals /i and /2 
respectively. 

Theorem 10. Suppose Pfi{v) < ip *P/2(w); Vu G V and ip > a constant, then 

HajAG) < H^j,{G) + - logV, (39) 

I — a 



ifO<a<l, 



if a > 1. 



HajAG) > H^jAG) -log^, (40) 

a — i 



Proof: Given Pf-^{v) < V' * P/2 (^^)- By raising to the power of a and by applying summation over the 
vertices of G, we get, 

< E(^-^'/^ (41) 

Taking logarithms on cither side, we get. 



log(EP/i(^r) ^ log(E(V^-p/,(i;))") , 
\vev / \vev / 



(42) 



■.\ogi, + \ogiY,iPfAv)r)- (43) 



Case 1: When < a < 1. Dividing either side of the equation by (1 — a), we get the desired expression 

Case 2: When a > 1. In this case, dividing either side of the equation by (1 — a), we get the expression 
(l40l) as desired. □ 



Corollary 11. Suppose fi{v) < ,f2{v), Vw G V, then 



i/0 < a < 1, 



if a > 1. 



HajAG) < H^jAG) + log ^, (44) 
Ho^jAG) > H^.fAG) ^^\og^, (45) 



S2 

Proof: By the assumption, we have Pfi{v) < -^Pf2{v). Therefore, the corollary follows by letting 

Si 

S2 

tp = — in the above theorem. □ 
61 
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Theorem 12. Suppose Pf^^iv) < P/aC^) + (j), Vu G V and (/) > a constant, then 



j/0 < a < 1, 



if a > I. 



1 TV • 



-f^a Ji (G) > Haj2 (G) - ^ _ ^ ■ 



l/c 



(46) 
(47) 



Proof: Suppose Pfi{v) < Pf2{v) + 0, Vw G V. By raising to the power a and by applying summation 
over the vertices of G, we get, 

Y.Ph^< ^T.^PfM + ^T- (48) 

Case 1: When < a < 1. 

By applying Lemma [5] to the above expression (|48l) we get, 



< Y.(Ps,{v)r + N-r- 

vev vev 
Taking logarithms on either side, we get 

log(Ep/,(iO") < log(E(p/,(i;))"+iV-r J , 



log 



E.evb/2(«))" 



log (^Ep/.(«rj +iog(^i + ^ 



< iog(Eb/.(«))^ 

VtXEV 



Dividing by (1 — a), we get the desired expression 
Case 2: When a > 1. 

By applying Lemma [2] to the expression (H51) we get, 



< 



(49) 

(50) 
(51) 
(52) 
(53) 



(54) 
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Now, taking logarithms on either side, we get 
log I 1 < a log 



l/c 



Y.^VfMT\ (i + 

log (^|](%(«))"^ +alog h 



a log 



■ (j) 



+ 



Dividing by (1 — a), we get the desired expression ((47]). 
Theorem 13. Let f{v) = cifi{v) + C2h{v), Vu £ V. Then, 



forO<a< 1, 



1 A? 



and for a > 1, 



1/q 



a- 1 



a - 1 



ffere, = J'^f'- „ and ^2 ^ " o ■ 
' ^ C1S1+C2S2 ^ C1S1+C2S2 



(55) 
(56) 

(57) 

(58) 

□ 

(59) 
(60) 



(61) 



Proof: Consider, f{v) = cih{v) + C2/2(w), Vw S F. Now let 5 E /(^) = ^1 E 
C2 E] f'^i'^) — ciSi +0282- Next consider. 



Pf{v) 



f{v) ^ Clhjv) + C2f2{v) 

s s 

ClSi . . 02^2 , , 



Now raising to the power a and summing it over all the vertices of G, we get 



(62) 

(63) 
(64) 



(65) 



Now let us make the cases of the theorem. 
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Case 1: < a < 1. Applying Lemmas we get 

vgv vev 

Taking logarithms on either side, we get 



iogEp/(«r < log E (^'/i ^2 E(^^^ 

< « log + log 1^ E (^))") + (^1^ 



Dividing by 1 — a, we get the required expression (|60p . 
Case 2: a > 1. Applying Lemma [5] yields, 



vev 



vev 



< 



wev 



wev 



wev 



\vev 



Taking logarithms on cither side, we get 



vev 



^og^Pfiv)" < a log 
= a log 



wev 



wev 



\vev I 

< alogAi+log E(f^/i(^))' 
\vev 



^ , A2{EveviPhiv)r) 
M {T.veviPfAv)r) 



alog(l + ^M^-M!M; 

M {EveviPfM)'^V 



(66) 
(67) 



(69) 
(70) 
(71) 
(72) 



(73) 
(74) 
(75) 



^■^2 iEveviPhi^)r 



(76) 
(77) 
(78) 
(79) 
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Dividing by 1 — a, we get the required expression (j6ip . 



□ 



Corollary 14. Let f[v) = Cifi{v) + C2/2(w), Vu e V. 
IfO<a<\, then 



1 



2(1 -a) 



Aa — Aot — 



(80) 



If a > 1, i/ien 



HcAG) >\[H^jAG) + H^jAG)] - 2(^^log(^i^2) 



a 



2(a - 1) 



1/c 



vev 



A. 



J 



vev 



\v£V 



(81) 



Here, Ai = ^'-f'^ „ and A' 



C2S2 



C1S1+C2S2 ' 



Proof: The proof follows similar to Theorem [T51 In the case of < a < 1, the equation (p^ is expressed 
as follows: 



log E < log E + E (w. ) , 

vev \ vev vev I 

=iiog ( A? E(p/i(^))" +^2 E(f^/=(^))" ) 

\ vev vev I 

+ \ log (a? e b/i (^))" + ^2 E (^'/^ ' 

\ vev vev ) 

ll \{ A^^( I NN^^ ^ : A^Y^veV^PfMr S 

A2E(^/.(.)) Ki+^.^^^^(,,^(.)) 



(82) 



(83) 



+ 2 log 



(84) 



Now proceeding as before and by simplifying each of the terms in the above equation, wc get the 
required expression (|80p . 



12 



Similarly, in the case of a > 1. the expression (|76p is expressed as, 



log^P/(w)" <alog 



vev 



a 

~ — log 
2 ^ 



= — log 
2 ^ 



^1 E(p/i("))" +A2[Y.iPhi^)r 

vev ) \vev 

\vev 
vev / 



— log 

2 ^ 



wev 



^1 (E.ey(P/iW)")° 



— log 

2 ^ 



^ , Ai{Y.vev{VfMTY^ 
M {T^veviPfMr)" 



As before upon simplification of the above equation, we get the required expression (j8ip . 



(85) 



(86) 



(87) 



□ 



Applications to chemical graphs 

In this section, we consider various classes of simple chemical graphs and illustrate the results from 
previous section. To this purpose we consider a specific example of the equivalence relation F on G 
and an information functional fp. In order to define concrete graph entropies, we need to specify graph 
invariants and information functionals to determine a probability distribution. 

For the graph invariant we use the automorphism group of a graph. We use this invariant due to their 
extensive investigations available in the literature; for example see f38j . Note that there are various other 
invariants such as distance, degrees and paths that could be used. Observe that each graph belongs to an 
automorphism group, where an automorphism is a permutation of the vertices such that the adjacency 
relation of the graph is preserved. An automorphism group divides the vertex set into orbits where a 
vertex orbit is a collection of topologically equivalent vertices. 

Definition 5. Let F be an automorphism (equivalence relation) that partitions the vertex set V of G into 
vertex orbits. Let ATi, . . . ,Xk be the k orbits of V such that = \ + • • • + \Xk\- 

For the information functional, we reproduce the definitions of two information functionals based on 
metrical properties of graphs [29H3T| . 

Let G = {V, E) be a simple, undirected graph on n vertices and let d{u, v) denote the distance between 
two vertices u and v, and let 77(G) = max{(i(u,w) : u,v € V}. Let Sj{u;G) denote the j-sphere of a 
vertex u defined as Sj{u; G) = {x ^ V : d{u, x) = j}. 

Definition 6. Parameterized linear information functional using j-spheres: 

V{G) 

f'piv.) = Y,Cj\S,{v,;G)\, (88) 

where Ck > for 1 < k < rj{G). 
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Definition 7. Parameterized exponential information functional using j -spheres: 

/p(v,;) =/?S;i?c,|S,K;G)|^ (gg) 

where /3 > and Ck > for 1 < k < rj[G). 

Note that the constants Cj's in the above expressions contribute to the weight of the j-spheres and 
hence the functional could be meaningfully interpreted when the Cj's are all distinct. 

Stars 

A Star Sn is a tree on n vertices where there is exactly one vertex of degree n — 1 and n — 1 vertices of 
degree n. Star graphs have been of considerable interest, since they represent trees with smallest possible 
diameter among all trees on n vertices. 

Theorem 15. Let T he an automorphism defined on Sn such that T partitions V{Sn) into two orbits, 
Xi and X2, with \Xi \ = 1 and \X2\ = n — 1. Then 

(90) 

for Q < a <1, 

Ho^ASn) < logn log(n-l) + ^ , (91) 

n in 2 

and for a > 1, 

77 — 1 fy — 1 

H^xiSn) > logn-— log(n-l)-^— ^^^j^^. (92) 



n ' ' (n-l)"-2ln2 

I _ n- 



Proof: Let pi = ^ = i and p-? = ^-M ^ So, p = maxj^i, 22.} = n - 1. Now, we have 

\V\ n \V\ n ' ' L r,^ 1 r,, J ' 



n - 1 

Hr{Sn) = log2n-^j-log2(n-l). (93) 

Observe that, 

Ho^ASn) = -^[Iog2(l + (n-l)")-alog2n]. (94) 
1 — a 

Now by Theorem [71 we have 

Ha,r[Sn) < Hr{Sn) H 2~hi^ ' ^ ' 

for < a < 1. Hence, 

7J„.r(5„) < log^n log2(7i - 1) + ^ ^4V^ • (9^) 

Similarly, for a > 1, we have by Theorem [71 

H^ASn) > Hr{S„)-^-f:^^^^^^. (97) 

77 — 1 (n — \) 

H^ASn) > log^n log2(7.-l)- \ J (98) 

77 (77, — 1)" • In 2 



That is, 



Hence the theorem. □ 
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Theorem 16. Let T he an automorphism on V{Sn) and let f be any information functional defined on 
V{Sn) such that \Xi\ < f{vi) and \X2\ < f{vj) for some i and j, 1 < i ^ j < n. Then, for < a < 1, 



and for a> 1, 



Hc^jiSn) > -^log(l + (n-l)")--^log5, (99) 
1 — a 1 — a 

HcjiSn) < -^log(l + (n-l)") + ^-log5. (100) 
1 — a a — 1 



Here S = J2vev fi'")- 

Proof: Follows by using equation (|94p in Theorem |8l □ 

Remark 17. For instance, when f ~ f'p defined by equation (|88l) with constants Ci,C2 > 1. We have 
^ — Ei,Gy(s„) /(^') ~ (^'-1 + C2("- — 2))(n — 1). By substituting the value of S in equations (|99)) and 
(jlOOp . we get the bounds for Haj'^{Sn)- 

Remark 18. At this point, observe that another class of graph that possesses the same automorphism 
group as the stars is the wheel graph. A wheel Wn is a graph obtained by joining a new vertex v to every 
vertex of an (n — l)-cycle C„_i. That is, W„ = C„_i + {v}. While studying the inequalities for this class 
of graph, we derived similar expressions as of theorems [15] and [121 Hence we conclude that the theorems 
[TCI and [T51 also holds for the wheel Wn- 

Paths 

A path graph, denoted by P^, are the only trees with maximum diameter among all the trees on n vertices. 
This class of graph has received considerable attention in chemistry when studying the hydrogen-depleted 
hydrocarbon molecules. Let F be an automorphism defined on P„, where F partitions the vertices of P„ 



into ^ orbits {X^) of size 2, when n is even, and ^^^—^ orbits of size 2 and one orbit of size 1, when n is 
odd 



Theorem 19. Let f be any information functional such that f(v) > 2 for at least ^ vertices of Pn and 
let F be as defined above. Then 

n 

1 a 

Ho..f{Pn) > log2 n - log2 S~l, ifO<a<l, (102) 

1 — a 1 — a 

1 a 

HcjiPn) < log2 n + log2 S-1, ifa>l, (103) 

1 — a a — 1 

where S = 

Proof: Ha,T{Pn) follows directly from the definition of Rcnyi entropy. Next, by using the value of 
Ha,r{Pn) in Theorem[51 we get the desired expression for Haj{Pn)- D 

Connected graphs 

In this section, we consider any general connected graph G and the functionals fp and f'p given by 
equations ([5^ and ([55]) respectively. In the next two theorems, we present the explicit bounds for the 
Renyi entropy Haj{G), when we choose the two information functionals in particular. 
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Theorem 20. Let f = f'p given by equation (j88p . Let Cmax = max{ci : 1 < i < 'r]{G)} and Cmin = 
min{ci : 1 < i < r]{G)} where Ci is defined in f'p. Then the value of fi^{G) lies within the following 
hounds. 

(104) 

When < a < 1, 

log2 n - —— log2 < H^j'^ (G) < log2 n + —— loga (105) 

and when a > 1, 

log2 — j- log2 < Hc^.f'^ (G) < log2 n H — - log2 (106) 

Proof: Given f{v) = f'p{v) = J2f=i Cj\Sj{v; G)| with Cj > for 1 < j < 77(G). Let c^ax = niax{cj : 1 < 
j < ?/(G)} and Cmin = niin{cj . I < j < ?7(G)}. We have, 

riiG) 

Similarly, 

/(i;) > (?i-l)c^i„. (108) 
Therefore, combining the Equations (|107p and (|108p and by adding over all the vertices of G, we get 

n{n - l)cmin < ^ f{v) < n{n - l)c,nax- (109) 

Hence, 

Cmin , / \ , Cjiiax /11n^ 

< pf{v) < . (110) 

^ ' Cmax ^ ' Cmin 

By raising to the power a and adding over all the vertices of G, we have 



< 



j:pf(-r <- • (111) 



71 • Cmax / , \ ^ ' C] 

Taking logarithms we get, 

loga n + a log^ < iog^ \^Pf{vT] < log2 n + a log^ '^"""'^ . (112) 

^ ■ Cmax V / ^ ' Cmin 

Dividing the expression (|112p by (1 — a), and simplifying we get the desired expressions given by (jlOSp 
and ()106p depending on the value of a. □ 

Theorem 21. Let f = fp given by equation (j89p . Let Cmax = max{ci : 1 < « < viG)} and Cmin = 
min{ci : 1 < j < '7(G)} where Ci is as defined in fp. Then the value of Haj'^{G) can be bounded as 
follows. 

(113) 

When < a < 1 , 

log^n-^^^^^log^/? <H^jAPn)< log2n+^^^^^log2/3, (114) 
1 — a 1 — a 

log2n- "(''~^^^ log2/? <i/.,/,(P„)< log2n+ "^"~^^^^ log2/3, (115) 
a — 1 a — 1 

max Cmin ■ 



an 



d when a > 1, 



where X ~ c. 
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Proof: Given f{v) = fp{v) ^ /3^?='?' '^^I^j^^-G^)! with > for 1 < j < r/(G). Let c^ax = max{cj : 1 < 
j < r]{G)} and Cmin = min{cj : 1 < j < ^K^)}- We have, 

f{v) = ^5:;i?=,i-s,(^;G)i < ^(„-i)c„..^ (^^g) 

Similarly, 

/(«) > (117) 
Therefore, combining the Equations (|116p and (|117|) and adding over all the vertices of G, we get 

^ . ^(n-i)c„.„ < ^/(w) < n-/?*"-!)""""-. (118) 

Hence, 

n ^ ^ ■ 

Let X = Cmax ^ Cmin- Now, by raising Pf{v) to the power a and adding over all the vertices of G, we 
have, 

1 \" .-^ //3("-i)^\" 



vev 



Taking logarithms we get. 



log2n-alog2(n./3("-i)^) < log2 ( ^ p/(«)" ) <log^n + a\og, f ^'" '^'' ) . (121) 



(1 - a) log2 n-a{n- l)Xlog2 P < log^ i^^Pfi 

\vev 



vev / ^ ^ 

r] <(!-«) log2 n + ain- 1)X log^ /?.(122) 



Dividing the expression (|122p by (1 — a), and simplifying we get the desired expressions given by (|114l) 
and PTS]) . □ 

Conclusions and Summary 

In this article, we have studied one of the most daunting problems in the study of information measures, 
that is, establishing relations between graph entropy measures. Among all the entropy measures, we 
have considered the graph entropies defined using the classical Shannon entropy and the Renyi entropy. 
Further, we have also considered two major types of probability distributions in the definitions of the 
entropies, namely the classical partition-based distributions and the recent non-partition-based distribu- 
tion defined on the vertices of the graph by using information functionals. Thus, we have established 
analytical relations when the two different types of distribution are used for the measures. 

In general, the results could be used in various branches of science including mathematics, statistics, 
information theory, biology, chemistry and social sciences. Further, the determination of analytical 
relations between measures gains practical importance when dealing with large scale networks. Moreover, 
relations involving quantitative network measures could be fruitful when determining the information 
content of large complex networks. 
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